Papers with code-switching ST
Generating Synthetic Speech from SpokenVocab for Speech Translation (2023.findings-eacl)
Copied to clipboard
| Challenge: | End-to-end speech-totext translation (ST) models require large amounts of data to train, but their size is considerably smaller than text-based MT data. |
| Approach: | They propose a method to convert MT data to ST data via text-to-speech systems. |
| Outcome: | The proposed method improves translation quality by an average of 1.83 BLEU score while performing equally well as TTS-generated speech in improving translation quality. |